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Abstract 

We introduce and discuss a concept of approximation of a topological algebraic system A 
by finite algebraic systems from a given class /C. If is discrete, this concept agrees with the 
familiar notion of a local embedding of A in a class JC of algebraic systems. One characterization 
of this concept states that A is locally embedded in K. iff it is a subsystem of an ultraproduct 
of systems from /C. In this paper we obtain a similar characterization of approximability of a 
locally compact system A by systems from JC using the language of nonstandard analysis. 

In the signature of A we introduce positive bounded formulas and their approximations; 
these are similar to those introduced by Henson jJJ for Banach space structures (see also 
|15l 1161). We prove that a positive bounded formula ip holds in A if and only if all precise 
enough approximations of (p hold in all precise enough approximations of A. 

We also prove that a locally compact field cannot be approximated arbitrarily closely by finite 
(associative) rings (even if the rings are allowed to be non-commutative) . Finite approximations 
of the field M can be considered as possible computer systems for real arithmetic. Thus, our 
results show that there do not exist arbitrarily accurate computer arithmetics for the reals that 
are associative rings. 

1 Introduction 

The numerical systems implemented in computers for simulation of the field M are based on rep- 
resentation of reals in floating-point form. These systems are finite algebras with two binary 
operations © and ©. The underlying set of any such system i? is a finite, symmetric subset of M 
{a £ R iS —a £ R for all a S M) on which the operations © and © are defined as follows. Let be 
the maximum of R. li x,y £ R and x + y (resp., x x y) £ [—N, N] then x(By (resp., a; © y) is the 
element of R nearest to x + y (resp., x xy). Here -|- and x are the addition and the multiplication 
in M. 11 X + y (resp., x xy) ^ [—N, N] then x®y (resp., x © y) is defined more or less arbitrarily. 
If such overflow happens during a computation, the numerical result might be incorrect; hence it 
is necessary to take care that the overflow not occur. (In a floating-point system, this is called 
exponent overflow; see ^| section 4.2.1].) 

The elements of a floating-point system R are distributed unevenly in the interval [— A^, A^]; 
they become especially sparse when one gets close to the endpoints of this interval. This non- 
uniformity entails a significant loss of accuracy in calculations with large numbers, even if the 
results of intermediate operations stay within the interval [—N, N]. However, there exists an interval 
[— M, M] C [— A^, A^] and a positive e such that R is e-dense in [— M, M] and for every x,y £ R \i 
x + y (resp., x x y) £ [— M, M], then x © y, (resp., x © y) approximates x + y (resp., x x y) with 
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an error that does not exceed e. By choosing the parameters of the floating-point system correctly, 
M can be made arbitrarily large and e arbitrarily small. 

According to the main definition in this paper (Definition 1), this means that floating-point 
systems provide a family of arbitrarily close finite approximations of the field M considered as a 
topological algebra. The algebraic properties of systems based on the floating point representation 
are discussed in [17], where it is shown that they are neither associative nor distributive. 

More generally, we consider in this paper "continuous" expansions of the field of real num- 
bers; these are universal algebras of the form TZ = (M, 1, x, -|-, /i, . . . , fm) where the operations fj 
are continuous. Several interesting questions about the general nature of approximations of such 
structures arise naturally. 

First, is there a general procedure for constructing approximate versions of theorems about 
continuous expansions of the reals? A strong version of this question is the following: given a 
proposition (p about such structures, can one construct propositions (pM,£ such that (/? holds for a 
given continuous expansion TZ of the reals if and only if for all large enough M and small enough 
e, the proposition v^M.e holds for all finite systems R approximating IZ on the interval [— M, M] 
with accuracy bounded by e? In section 4 we do exactly this in an explicit way for positive first 
order sentences if in which each quantifier is restricted to a bounded interval of reals (Corollary [21 
to Theorem EJ. It seems very difficult to do this in a more general setting. 

This kind of question may be important for an understanding of the following type of problem. 
Suppose we use some convergent numerical method for computation of a real function, or a func- 
tional, or an operator. The theorem about convergence of this method is a theorem about the field 
M but in our computer-based "applications" of this theorem we use a finite system R, which only 
approximates M. Can we be sure that the result of our computation is approximately correct if we 
can use large enough numbers and high enough accuracy? The fact that this problem is natural 
can be demonstrated by the following example (concerning the approximation of sinx), which is 
discussed in section 3.8]. 

Although the Taylor series for sinx converges for all x, the approximate computation of sinx 
for large x based on its Taylor expansion gives an incorrect answer in a fioating-point system. For 
large x, the first few terms in a partial sum of this series are also very large. Due to the fixed 
number of digits in the fioating-point representation of real numbers, the addition of terms in a 
partial sum of the series should be done with the terms taken in ascending order, to avoid roundoff 
error; this is explained in [211 chapter 2]. However, calculation of the k*^ term of the Taylor series 
for sinx produces exponent overfiow for large x and k. 

A second natural question concerning finite algebraic systems approximating M is the following. 
What properties of continuous expansions of the reals can hold for some finite systems that approx- 
imate them arbitrarily closely? For example, let Lp be any first order theorem about the field M; is it 
true that for any big enough M and small enough e there exists a finite system R approximating M 
on the interval [— M, M] with accuracy e such that (p itself holds for i?? We mentioned above that 
the operations © and in numerical systems based on the floating-point representation are neither 
associative nor distributive. Is it possible to construct finite rings that approximate M arbitrarily 
closely? (Here we answer this question in the negative; see Theorem ^ It is easy to construct 
approximating systems for R that are abelian groups for ©; see Example 2 in section 2.) 

These problems are discussed in the present paper in a more general setting. We consider a 
locally compact algebraic system A = (A, 6) of finite signature 6 with only function symbols (a 
universal algebra) and give a definition of approximation of this system by a finite system Af on a, 
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compact set C <Z A with accuracy W . Here W is an element of the uniformity on A that defines its 
topology. We call Af & (C, T^)-approximation of A. For example, if the topology on A is defined 
by a metric p, then we may take W = {{x,y) G \ p{x,y) < e} for some e > 0. The universal 
algebra A is said to be approximable by finite algebras from a class /C if for any C and W there 
exists a (C, VF)-approximation Af G JC. The definition of approximation of a locally compact group 
by finite groups discussed in [ll is a particular case of this definition. It is known that all 
locally compact abelian groups are approximable by finite groups but this is false in general for 
nonabelian groups There exist groups that are approximable neither by finite groups, nor by 
finite semigroups, nor even by finite quasigroups ^ jE] jjj. It is proved in J2] that the field M is 
not approximable by finite fields; the signature here includes not only the operations of addition 
and multiplication but also an operation giving the multiplicative inverse of each nonzero element. 
Based on these results we show here that locally compact fields are not approximable by finite 
(associative) rings (Theorem 1). That is, it is impossible to implement in a computer a numerical 
system for arbitrarily accurate simulation of the field of reals that is a finite (associative) ring. 

In [2] (see also |B]) finite approximations of locally compact abelian groups are used for a con- 
struction of finite dimensional approximations of pseudodifferential operators. In this approach 
one simultaneously approximates the operators and the group structures associated to them. This 
allows constructing approximations which have nice properties (e.g., uniform convergence and spec- 
trum convergence). Usually, algebraic and geometric structures connected with operators can be 
considered as finite dimensional manifolds (e.g., the symmetry groups of operators are often Lie 
groups). Thus approximations of these structures can be based on approximations of the field M 
together with some other continuous functions on M. Approximations of the other locally compact 
fields can be used in p-adic analysis, adelic analysis, etc. This is another reason for investigation 
of finite approximations of topological algebraic systems. 

Nonstandard analysis provides a natural language in which to discuss approximate versions of 
statements about the reals; here we return to the first general problem discussed in this Introduction. 
For background on nonstandard analysis see, e.g., the recent books [H], JUj, and JH]- A brief 
introduction adequate for understanding sections 3 and 4 of this paper is contained in P", Section 
4.4]. 

It is easy to construct approximate versions of first order statements about continuous expan- 
sions TZ of the field M using the language of nonstandard analysis, as we describe next. Let ip 
be a first order sentence in the language of TZ. Prenex rules and the presence of the arithmetic 
operations x , -|- allow us to put (p into an equivalent (in TZ) normal form 

QlXi . . . Qm^m — i] 

where each Qj is either V or 3 and s, t are terms. Now let R be any hyperfinite approximation of 
TZ (see Definition |5J whose underlying set is contained in *M; the mapping j : R ^ *M is taken to 
be the inclusion. It is then clear that <p holds in TZ if and only if the sentence 

Ql Xi . . . QIji Xm [s ~ t\ 

holds in R; in a quantifier of the form Q^^^x we take x to range over the finite elements of R. (See 
Proposition [T^) 

Standard reformulations of such nonstandard approximations can be obtained using Nelson's 
algorithm [221 Section 2] for the translation of nonstandard statements into standard language. 
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Unfortunately, in the general case these standard versions are extremely complicated. (Without 
using Nelson's algorithm, we construct (section 4) comprehensible translations for a large class of 
first-order sentences, the so-called positive bounded sentences that we introduce here.) 

Approximate versions of first-order sentences are discussed in this paper for the general case of a 
locally compact algebra of finite signature. The results obtained for our positive bounded sentences 
are similar to well-known results about such sentences in the theory of Banach spaces jl4| |13j |16j 
(see also flF). 

The problem of constructing (nonstandard or standard) approximate versions of higher order 
statements about M is also open and it seems interesting and important. Solving it might lead to 
a deeper understanding of the interaction between continuous mathematics and its finite computer 
approximations . 

The authors are grateful to the referee for valuable remarks and important suggestions. 

2 Approximation of locally compact algebras 

Let A = {A, 9) be an algebraic system of finite signature 9 that contains only function symbols. 
We assume that A is endowed with a locally compact Hausdorff topology and that the function 
symbols of 6 are interpreted by continuous functions. (We denote these interpretations using the 
same letters as the corresponding function symbols m. 9.) 

Let C C A be a compact set, U a finite covering of C by relatively compact open sets (an r.c.o. 
covering), Af = {Af,6) a finite algebra of signature and j : Af ^ A a mapping. The interpretation 
of a function symbol g £ 9 in Af is denoted by gj. For ai, . . . a„ E j4j we denote by j((ai, . . . , a„)) 
the n-tuple (j(ai), • • • ,j{an)) ■ We say that a,b e C are Z^-close if 3U {a e U Ab e U). 

Definition 1. 1. We say that a set M C A is a {C,U)-grid (equivalently, M is aU-grid for C) 
if for any c £ C there exists an m £ M such that c and m are U -close. 

2. We say that j is a {C ,lA)-homomorphism if for any n-ary function symbol g £ 9 and for any 
a G Aj such that j{a) G C"' and g{j(a)) G C , the elements g{j{a)) and j{gf{a)) are U-close. 

3. We say that the pair {Af,j) is a {C,U)- approximation of A if j is a {C,U)-homomorphism 
and j{Af) is a {C,U)-grid. 

4- Let KL be a class of finite algebras of signature 9. We say that the locally compact algebra A 
is approximable by finite KL-algebras if for any compact set C <Z A and for any finite r.c.o. 
covering li of C there exists a [C^U)- approximation {Af,j) of A such that Af £ KL. 

Remark 1. If the topology on A is discrete, then condition (4) in Definition ^ is equivalent to the 
well-known model-theoretic concept of local embedding of an algebraic system {A, 9) in a class fC of 
algebraic systems of the same signature 9 (see e.g., [ID])- The class of discrete groups approximable 
by finite groups was studied in |22]. It was shown, in particular, that in this case we obtain the 
same class if we assume that the mapping j is injective. It is not known whether this is true for 
approximation of topological algebras or even for approximation of discrete algebras other than 
groups. 

Remark 2. Note that if in the item 2 of Definition ^ one has range (5) n C = for all g £ 9 or 
range(j) H C = 0, then the mapping j is a (C,i^)-homomorphism. 
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Usually we deal with the case of a uniformly locally compact topology on A. This means that 
the topology on A is determined by a uniformity W and there exists E W such that for any 
X £ A the set W{x) = {y £ A \ {x,y) £ W} is relatively compact. For example, all locally 
compact groups satisfy this condition. For uniformly locally compact algebras of signature 9, we 
assume that the interpretations of function symbols are continuous, but not necessary uniformly 
continuous. For example, M is a uniformly locally compact space, but multiplication in M is not 
uniformly continuous. It follows from the general theory of uniform spaces (see, for example, 0|) 
that the restriction of a continuous function to a compact subset C is uniformly continuous on C. 
For the case of uniformly locally compact algebras Definition ^4) can be simplified. 

We assume now that ^ is a uniformly locally compact algebra of signature 9 and W is an 
element of the uniformity W such that \/x £ A [W{x) is compact]. (Here and below the closure of 
a set E is denoted by E). Without loss of generality we may assume that W is symmetric (i.e., 
{x,y) £ W iS {y,x) £ W). The objects C, Aj and j satisfy the same assumptions as above. We 
say that a,b £ C are VF-close if (a, b) £ W. 

Definition 2. 1. We say that a set M C A is a {C,W)-grid (equivalently, M is a W -grid for 
C ) if for any c £ C there exists an m £ M such that c and m are W -close. 

2. We say that j is a (C, W)-homomorphism if for any n-ary function symbol g £ 9 and for any 
a £ AJ such that j {a) £ and g{j{a)) £ C, the elements g{j (a)) and j{gf{a)) are W-close. 

3. We say that a pair {Af,j) is a {C,W)- approximation of A if j is a (C ,W)-homomorphism 
and j{Af) is a (C, W)-grid. If Af d A and j: Aj ^ A is the inclusion map, we say that Aj 
is a {C,W)- approximation of A. 

4- Let IC be a class of finite algebras of signature 9. We say that a uniformly locally compact 
algebra A of signature 9 is approximable by finite KL-algebras if for any compact set C C A 
and for any W £yV such that ^x £ A W{x) is compact, there exists a (C, W) -approximation 
{Af,j) of A such that A f £ JC. 

We omit the simple proofs of the following four propositions. 

Proposition 1. For every uniformly locally compact algebra A, any compact set C ^ A and 
any element of the uniformity W £ W such that \/x £ A [W{x) is compact], there exists a finite 
(C, W)- approximation of A. 

Proposition 2. If A is a compact set, then A is approximable by finite IC-algebras in the sense of 
Definition\^ iff for any W £}V there exists a finite IC-algebra that is an {A, W)- approximation of 
A. 

Proposition 3. If {Af,j) is a {C,W)- approximation of A in the sense of Definition\^ and we 
have a compact set C ^ C and W 9 W' 5 W, then the pair {Af,j) is a {C' ,W')-approximation 
of A. 

Proposition 4. A uniformly locally compact algebra A is approximable by finite IC-algebras in the 
sense of Definition^ iff it is approximable by finite fC-algebras in the sense of Definition\^ 

Remark 3. Proposition 0] shows that approximability of a uniformly locally compact algebra A 
by finite /C-algebras is a topological property; it does not depend on the uniformity on A but only 
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on its topology. This fact is significant; for example, a topology on a locally compact group is 
determined by the left uniformity and by the right uniformity. It is well-known that these two 
uniformities are not equivalent for some classical groups, e.g., for the group SL{2,M). 

Since we deal only with uniformly locally compact algebras, in what follows we use only Def- 
inition 121 although all of our results hold for the general case (after obvious reformulations and 
modifications of proofs). 

Let ^ be a metric locally compact algebra with metric p and = {{x,y) \ p{x,y) < e}. In 
this situation we will write (C, e)-approximation (-grid, -homomorphism, etc) instead of {C,Ws)- 
approximation (-grid, -homomorphism, etc). Similarly, we will write e-grid for C instead of (C, W^)- 
grid. 

Next we consider some examples of approximations of the field M. We use the signature a = 
(+, x). Since any compact set C C M is contained in the interval [—a, a] for some a, and the sets 
We = {{x, y) \ \x — y\ < e}, e > form a base of the uniformity on M, it is enough to consider only 
the ([— o, o],VF£) -approximations of R. We will refer to them as (a, e)-approximations. 

Example 1 Recall that the floating-point form of a real a is: 

a = ±WP X O.aiaa . . . , (1) 

where p £ Z, and aia2 ■ ■ ■ is a finite or infinite sequence of digits such that < a„ < 9, and 
ai 7^ 0. The integer p is called the exponent of a, and 0.aia2 . . . , its normalized fraction part or 
mantissa. Our discussion of fioating-point arithmetic mainly follows that of ^Jj, differing only in 
some inessential technical details. 

Fix natural numbers P, Q and consider the finite set Apq of reals of the form (1) such that the 
exponent p oi a satisfies |p| < P and the mantissa of a contains no more than Q decimal digits. 
We define binary operations © and on Apq. In what follows, * stands for either + or x. Let 
a, P G ApQ and suppose the normal form of a * /3 is 

a * /3 = ±10'' X 0.C1C2 .... (2) 

Note that the mantissa of a * /? may contain more than Q digits. In the following definition, the 
symbol ® stands for © or for ©, depending on whether * stands for + or for x. Then we define 



a® P 



±10'' X 0.C1C2 ...CQ if |r| < P, 

±10^x0.99_^ if r>P, 

Q digits 

if r < -P. 



If the mantissa of a * /3 contains fewer than Q digits we complete it to a Q-digit mantissa by adding 
zeros at the right. 

Denote by Apq the algebra (^pq,©,©) in which the interpretations of the function symbols 
+ and X are the functions © and ©, respectively. It is easy to see that for any positive a and 
e there exist natural numbers P and Q such that the algebra Apq is an (a, e)-approximation of 
M. The systems Apq are implemented in working computers. What properties of addition and 
multiplication of the field of reals hold for © and ©? 

It is easy to see that the operations © and © are commutative, ^ © {—^) = and ^ © = for 
any ^ G Apq. Let a = (3 = 0.60 ... 06 and 7 = 0.60 ... 05 (with Q digits after the decimal point). 
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Then a©/3 = a©7, so the cancenation law fails for ©. Thus the associative law also fails for ©. 
It is easy to construct examples to show that the laws of associativity for © and distributivity for 
©,© in ApQ also fail. See jl7| section 4.2.2] for some other identities of real arithmetic that hold 
in these floating-point systems. 

Example 2 Fix a natural number M and a positive e. Put j4^,j^ = {ke \ — M < k < M}. 
Let = 2M + 1. For any n G Z we will denote by n(mod A^) the unique element of the set 
{k I —M < k < M} that is congruent to n modulo N. The operations © and © on A'p^ ^ are 
defined as follows: 

ke Q me = {k + m){mod N)e, (3) 
ke © me = [A;me](mod N)e. (4) 

Denote by A'j^ ^ the universal algebra in signature 6 with the underlying set A'j^ ^ and the 
interpretation of the function symbols defined by formulas (3) and (4). It is easy to see that A'j^^ 
is an {Me, e)-approximation of M. It is obvious that A'j^^ ^ is an abelian group with respect to © 
(see (3)). However, one can easily construct examples which show that for any big enough M and 
small enough e the multiplication © satisfies neither the associative law nor the distributive law. 

Example 3 Consider approximation of the locally compact field Qp of p-adic numbers. Recall that 
any p-adic number a ^ can be uniquely represented in the form 

oo 
v=n 

where n £ Z and for all > n in Z one has < Ojy < p; moreover, the representation is normalized 
by taking a„ 7^ 0. The p-adic norm of a is then given by the formula 

|a|p=p-", (8) 

The set Zp = {a | \a\p < 1} is a compact subring of Qp, the ring of p-adic integers. For 
any m G Z consider the compact additive subgroup p~'^Zp = {a \ \a\p < p"^}. The sequence 
{p~™Zp I m G Z} is a monotone sequence of compact sets that covers Qp. Hence, it is enough to 
consider only the (p~"^Zp,p~"')-approximations of Qp for all m, n E N. 

For any n > 0, the set p"Zp is an ideal in Zp and its quotient ring Kn is equal to Z/p"Z. We 
represent an element of this ring by its positive residue modulo p", so Kn = {0, 1, ... — 1}. We 
have Kn C Zp as sets. However, the ring operations in these sets are distinct. Indeed, addition 

+ and multiplication x of natural numbers in Zp are the same as in N, while addition © and 

00 

multiplication © in Kn are equal to addition and multiplication modulo p". For a = Yl '^uP'^ ^ 

n-l 

denote by a„ the number ^ a^p'^ S Kn- Then |a — a„|p < Hence, Kn is a p^^-grid for Zp. 
It is easy to see that 

\a + P-{ane /3„)|p, |q X /3 - (a„ © /3„)|p < p"". 

Thus, the inclusion map of Kn into Zp is a ^"'"'-homomorphism. Hence, the ring Kn is a 
(Zp,p~")-approximation of Zp. It follows that the compact ring Zp is approximable by finite 
commutative associative rings. (See Proposition [3) 
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To construct a {p '"Zp,^ ")-approximation (0 < m < n) of Qp consider the set Hm,n C 



n-l 

p~"^Zp of ah numbers of the form ^ Oj/p'^- Obviously, -ffm.n is a p~"-grid for p~™Zp. We 

1'=— m 

define operations © and such that the inclusion map of Hm,n into p'^^'Lp is a (p~'"Zp,p^")- 
homomorphism. 

Note that a G i^7n,n iff p^ot G i^m+n- For any a, /3 S -ffm.n put 

a©/3 = p-™ (^'"a © p'"/?) , 

where © is the addition in Km+n- 

The definition of © is more complicated. Let 

p^a X = CO + Cip + • • • + C™_ip™-1 + C^p'" • • • + C2^+2n-2/'"+'"-'. 

Put 

It is easy to see that for all q, /3 G Hm,n 

\a + [3 - a®(i\p <p"", 

and if a X /3 G p^^Zp, then 

|a X /? - a©/3|p < p"". 

Note that a x /3 G p~'^Zp iff = for A; < m. 

This proves that the inclusion map of Hm,n in Qp is a (p~"^Zp, p~")-homomorphism. 
Obviously, {Hm,n,'S)) is an abelian group isomorphic to the additive group of Km+n- 
It is easy to see that for any integer c such that < c < p one has ^©^ = 0. Thus 

^©1©^©! = 0, while (^^©^^ ©^ = This shows that the distributive law fails for 
© and ©. 

Since 0©p = and i©p = 1, we have (^^®^) ©P = 0, while ^© (^|©p) = This shows 

that the associative law fails for ©. 

In all these examples, the finite algebras that approximate the locally compact fields fail to be 
rings. Indeed, this is inevitable, as the following theorem shows: 

Theorem 1. No infinite locally compact field can be approximated by finite (associative) rings. 



Proof. Let K he a locally compact field, the additive group of K, and the multiplicative 
group of K. In this proof we denote the multiplication in X by •. This multiplication is a continuous 
action of i^T^ on K^. It is obvious that this action does not preserve the Haar measure on K^. 

Recall that a locally compact group is said to be unimodular if the left and right Haar measures 
coincide. 

It is well known ^S] that if a unimodular group G acts continuously on a unimodular locally 
compact group H by automorphisms and this action does not preserve the Haar measure on H, 
then the semidirect product of G and H is non-unimodular. 
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Thus, the semidirect product is a non-unimodular group. This semidirect product is 

isomorphic to the matrix group 

^={(0 1 ^^^}- 

Let us assume that K is approximable by finite associative rings and prove under this assumption 
that G is approximable by finite semigroups. 

The group G is homeomorphic to x K as a topological space. Put 

We = {{ia,b),{a',b')) \a,a' eK"", b,b' e K,ma^{\a - a'lx, \b-b'\K}<e}, 

where | • j^" is the norm in K 

We have to show that for any compact sets A C and B d K there exists a {A x B^W^)- 
approximation {S,j) such that S is a semigroup. 

l^ei D = A{J B{J {A - B). Then D is a compact subset of K (here A-B = {a-b \ a £ A, b G B}). 
For any positive 5 denote by Us the set {{a,b) £ K \ \a — b\K < S} and put C = U^i2{D), where 
U^I2{D) = IJ U^j2{d). Since is a compact set and any open ball in K is relatively compact, we 

have that C is a compact set also. 

According to our assumption, there exists a finite associative ring (F, ©, 0) and a map j : F ^ K 
such that the pair {F, j) is a (C, ?7£/2)-a'PProximation of the field K. Our group G is equal to x K 
as a set. The multiplication in G is given by the formula 

(a, b) • {c, d) = {a • c,a ■ d + b). 

Consider the finite set S = F* x F and the multiplication in S given by the formula 

{s,p) (g,r) = {sQq,sQr®p). 

Since F is an associative ring, it is easy to see that .S is a semigroup. 
Define the map i: S ^ G by the formula 

t{{a,b)) = {j{a),m. 

Since j{F) is an C4/2-grid for C and thus, for A and B, it is obvious that i{S) is a 
for Ax B. 

Let i{{s,p)),i{{q,r)),i{{s,p)Q{q,r)) eAxB. By the definition of i, we have j(s),j(g),j'('S0g) G 
A. Hence, 

\j{s)-j{q)-j{sQq)\K < |. 

Since j{p),j{r) G B, we have j{s) ■ j{r) e A - B C D C C. Thus, \j{s) ■ j{r) - j{s r)\K < | 
and j{s Qr) e C. Hence, 

\j{s)-j{r) +j{p) - ij{sQr)+j{p)) k < | 

and 

\j{sQr)+j{p)-j{{sQr)(S)p)\K < |. 
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Thus, 



\j{s) • j{r) + j{p) - j ((s Qr)e>p)\K < e. 



This shows that i is an {A x VFe)-homomorphism. 

Thus, the non-unimodular group G is approximable by finite semigroups. 

By Theorem 4 of [Z], if a locahy compact group is approximable by finite semigroups, then it is 
approximable by finite groups. 

By Corollary 1 of Theorem 1 of ^2. , if a locally compact group G is approximable by finite groups 
(indeed, even if only by finite quasigroups) , then G is unimodular. This contradiction completes 
the proof. □ 



3 Nonstandard characterization of approximability 

We first recall some well-known notions and results from nonstandard analysis. (See the books 
[H] ^Oj ^Hj or the brief introduction in Section 4.4] for necessary background.) In this section, 
7^(M) denotes the cardinality of the set M. 

Let U be a nonstandard universe and k an infinite cardinal. Recall that U is /{^-saturated if 
for any family of internal sets in U such that < k and satisfies the finite intersection 

property one has H-^ 7^ 0- 

Let A = {A, 9) be as in the previous section, a uniformly locally compact algebra of finite 
signature 6. We again assume that 6 contains only function symbols and that they are interpreted 
by continuous functions, which we denote by the same letters as the respective function symbols. 

Let A be the least infinite cardinal greater than the weight of the topology on A and the weight 
of the uniformity on A. (The weight of a topology on A is the minimal cardinality of a base of 
this topology and the weight of a uniformity on A is the minimal cardinality of a base of this 
uniformity) . 

Proposition 5. There exists a family C\ of compact subsets of A with the following properties: 

• #(Ca) < A; 

• Cx is closed under finite unions; 

• for any C & Cx the interior C° of C is nonempty and \J{C° \ C gC^} = A. 



Proof Let Wa be a base of the uniformity on A of cardinality less or equal to A. Without loss 
of generality we assume that Wa consists of elements W such that for all x G A the set W{x) is 
open and relatively compact. Let D be a dense subset of A such that #(-D) < A (to obtain such D 
pick an element from each set in a base of the topology on A of least cardinality). Take Cx to be 
the family of all finite unions of the sets W{d)^ where W G Wa and d £ D. Then Cx satisfies the 
conditions of the proposition. □ 
Throughout this section we deal with an arbitrary but fixed A"'"-saturated nonstandard universe 
U, with a fixed family Cx satisfying Proposition 1^1 and with a base Wa of the uniformity W such 
that #(Wa) < A. 

The nonstandard extension *A of A is the algebraic system ( *A, 6), where any function symbol 
f € 6 is interpreted in VI by the nonstandard extension */ of the operation / in A. In what follows 
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we omit the symbol *in notations of Vl-operations; i.e., we denote the interpretations of a function 
symbol f e 9 in A and in *A by the same letter /. 

For a, /3 G *A we write a ~ /? if yW G W {a, (3) G *W . In this case we say that a and (3 are 
infinitesimally close. Obviously, q ~ /3 iff {a, (3) G *W holds for all W G Wx- An clement a of *A 
is called nearstandard if a « a holds for some a G A. Since W is a Hausdorff uniformity, if such an 
a e A exists, then it is unique. In this case a is called the standard part or the shadow of a and it 
is denoted by °a. If a is nearstandard, then f3 ^ a iS for every open set U containing °a one has 
P e *U. Recall that for any a e A the external set 

^(a) = p){ 17 I a e [/ and is open} = f] *W{a). 

weWx 

is called the monad of a. 

Denote the family of all compact subsets of A by C. 

For B C *A, we denote by ns{B) the set of all nearstandard elements of B. It is well-known 
that a set C C A is compact iff ns( *C) = C. Thus, since ^ is a locally compact space, we have 

ns{*A) = IJ *C= IJ *C (9) 

CeC C&Cx 

Let f £ and / : A'^ — > A for some standard natural number n. Since / is a continuous function, 
it is well-known that for any a.,(3 G (ns(*A))" one has 

a « ^ ^ /(a) fiP) (10) 

Note that implication (10) holds for arbitrary a,^ G (M)" iff the function / is uniformly 

continuous. 

The statements (9) and (10) and some of their obvious modifications can be found in any of 
the books concerning nonstandard analysis that were mentioned above. 
Statement (10) implies the following: 

Proposition 6. 1. The external set ns{*A) is closed under 9 -operations; i.e., {ns{*A),9) is a 
subalgebra of *A. We denote this subalgebra by ns{*A). 

2. The mapping st: ns(*A) A defined by the formula st(a) = °a is a surjective homomorphism 
of algebras such that 

st{a) = st{(3) <J=^ aK, (3. 

Thus the equivalence relation ~ restricted to ns{ *A) is a congruence relation on ns{ *A) and 
the algebra ns{ *A) / ^ is isomorphic to A. 

Let Ah be a hyperfinite algebra of signature 9; i.e Ah = {Ah, 9), where Ah is a hyperfinite set 
and every function symbol f E 9 is interpreted by an internal function, which is denoted by fh- 

Definition 3. Let Ah be a hyperfinite algebra of signature 9 and let j : Ah — *A be an internal 
mapping satisfying the following conditions: 

1. Va G G Ahj{b) a; 
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2. if f £ 9 is an n-ary function symbol in 6, b €z and j(b) S (ns(M))", then j{fh{b)) ~ 
fijib)). 

Then we say that the pair {Ah,j) is a hyperfinite approximation of the algebra A. 

Assume that {Ah,j) is a hyperfinite approximation of A. 

Put {Ah)b = J~^(ns( *A)). Elements of the set {Ah)b are said to be feasible. 

For 6i,&2 e Ah put bi ~ 62 if ~ j(&2)- 

We call ~ the indiscernibility relation. If 61 ~ 62 we say that the elements 61 and 62 are 
indiscernible. 

Definition 131 and Proposition |^ imply immediately the following: 

Proposition 7. 1. The external set {Ah)b is closed under 9-operations; i.e., {{Afi)b,9) is a 
subalgebra of Ah We denote this subalgebra by {Ah)b- 

2. The mapping sto j = l: {Ah)b A is a surjective homomorphism of algebras such that for 
any 61,62 G {Ah)b one has 

L{bi) = ^(62) <^=^^ bi ~ 62- 

Thus the indiscernibility relation ~ restricted to {Ah)b is a congruence relation on {Ah)b CLnd 
the algebra {Ah)b/ ~ 't-s isomorphic to A. 

Put M = Ca X Wa and consider the partial order < on M such that if rn-j = (Cj, Wi) G M, i = 
1,2, then 

mi < m2 Ci 5 C2 A W'l C W2. 
For m £ M denote the set {m' £ M \ m' < m} by Mm- 

Let (C, W) £ *M. By the transfer principle, the internal set C is *-compact. We recall the 
meaning of this notion. Let T be the topology on A. For any statement P, the *-version of P is 
obtained by restricting all quantifiers to internal sets. Any standard set S involved in P should 
be replaced by its nonstandard extension *S. Thus, an internal set C C A is *-compact if for any 
internal family U C *T' such that C C |JZ//, there exists a hyperfinite subfamily V C Z// such that 
CQ[jV. 

Again let Ah be a hyperfinite algebra of signature 6 and let j : Ah *A be an internal mapping. 
If (C, W) £ *M, then we say that {Ah,j) is a (C, T^) -approximation of *A if {Ah,j) and *A satisfy 
Definition 133). 

We say that a pair (C, W) £ *M is infinitesimal if for any {D, V) £ M one has {C, W) < 
{*D, *V). Obviously, if {C,W) £ *Mx is infinitesimal then C D ns(M). 

The following lemma is an immediate consequence of our assumption that the nonstandard 
universe U is A^-saturated. 

Lemma 1. Let N be an internal subset of *M . The following statements hold. 

1. If for every {D,V) £ M one has {*D, *V) £ N, then there exists an infinitesimal element 
(C, W) £ N; 

2. if N contains all infinitesimal elements of *M, then there exists an m = {D, V) £ M such 
that *Mm ^ A^. 
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Lemma 2. A pair {Ah,j) is a hyperfinite approximation of the algebra A iff {Ah, j) is a {C,W)- 
approximation of *A for some infinitesimal {C, W) G *M. 

Proof (<^=) Let a e A. Since j{Ah) is a (C, T^)-grid, there exists b e A^ such that {a,j{b)) G W. 
Thus, for any V €W one has {a,j{b)) £ *V; i.e., j{b) ~ a. Let / G be an n-ary function symbol 
and fh its interpretation in Ah', take a G (Ah)]!^; i.e., j{a) G ns(*yl)" C C". Since / is a continuous 
function, we have f{j{a)) G ns(*A). Hence f{j{a)) G C. By Definition |21 and the transfer principle, 
{j{fh{a)),f{j{a))) G W. Thus, j{fh{a)) « f{j{a)). So is a hyperfinite approximation of ^. 

(=^) Let {Ah,j) be a hyperfinite approximation of A. Obviously, for any {D,V) G M the pair 
{Ah,j) is a (*-D, *y)-approximation of VI. By Lemma ^1), there exists an infinitesimal {C,W) 
such that {Ah,j) is a (C, Vl^)-approximation of VI. □ 

Theorem 2. A uniformly locally compact universal algebra A of finite signature 9 is approximable 
by finite algebras from a class K. iff there exist a hyperfinite algebra Ah = {Ah, 9) G */C and an 
internal mapping j: Ah — > *A such that the pair {Ah,j) is a hyperfinite approximation of A. 

Proof (=^) Let A be approximable by finite /C-algebras and let (Co, Wq) be an infinitesimal element 
of *M. By the transfer principle, there exists a hyperfinite algebra Ah G */C and an internal mapping 
j : Ah ^ A such that the pair {Ah,j) is (Co, Wo)-appi'oximation of *A. By LemmalJl {Ah,j) is a 
hyperfinite approximation of A. 

(<^) Let {Ah,j) G */C be a hyperfinite approximation of A. By Lemma 121 {Ah,j) G */C is a 
(Co, VFo) -approximation for some infinitesimal (Co,VFo) G *M. Then by Proposition |21 and the 
transfer principle, the pair {Ah,j) is a (*C, W)-approximation of *A for all {C,W) G M. By 
the transfer principle (used in the opposite direction), for every {C,W) G M there exists a finite 
(C, W^)-approximation of A that belongs to /C. □ 

Corollary 1. For every uniformly locally compact algebra A, there exists a hyperfinite approxima- 
tion of A. 

Proof Take JC to be the class of all finite algebras of signature 9 and apply Theorem [21 and 
Proposition^ □ 

Remark 4. It follows from Definition ^ and Proposition |31 that Theorem (21 holds if we take our 
nonstandard universe only to be "^-saturated, where u is the weight of the topology on A. 

The topology on {Ah)b/ ~ induced by its isomorphism to A can be defined in terms of the triple 
{Ah, {Ah)b, ~)- We will now do this in a more general setting. 

Recall that an external subset of a A^-saturated universe is called a cj-set (respectively, a vr-set) 
if it can be represented by a union (respectively, an intersection) of a family of internal sets of 
cardinality < A. Obviously {Ah)b is a cr-subset of A, while ~ is a vr-set contained in A^. 

The above considerations provide motivation for the following: 

Definition 4. We say that a triple r = {T,Tb,p) is an abstract nonstandard topological triple if 
T is an internal set, Tb ^ T is a a-subset and p is a n -equivalence relation on T such that for 
every a £ Ti, the set p{a) = {(3 £ T \ {a, (3) G p} is contained in T^. We call the set of 
abstractly feasible elements and p the abstract indiscernibility relation. If T is hyperfinite, we call 
T a hyperfinite topological triple. 
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We now introduce a topology on the quotient set T = T^/p. For a G T denote by the 
/9-equi valence class of a. 

Let F CT. Put i{F) = {a e F \ C F}. Denote by I the family of all internal subsets of Tj,. 
Let Tr be the topology on T obtained by taking the family {i{F)P \ a £ i(-F), -F G T} to be a base 
of neighborhoods of the point a^, for each a G Tf,. Here i[FY = {(3^ \ (3^ C i^}. 

The construction of the topological space (T^, TJ-) is a generalization of the well-known construc- 
tion of the nonstandard hull. This generalization was introduced in [2] for the case of hyperfinite 
abelian groups (see also jllj). 

Theorem 3. 1. The weight of the topology Tr is < X. 

2. The topological space {T,%-) is locally compact iff for every internal set F <^Tf, and for every 
internal set G such that p C G T x T there exists a set K F of standard finite cardinality 
that satisfies the following condition: 

FQ f] G{a). 

3. If ^- T" T is an internal n-ary operation on T for some standard n, and we assume 
that the set Tf, of feasible elements of T is closed under ip and (p \ Ti, is stable under the 
indiscernibility relation p; i.e., 

Va, a' G T^ {apa' — > ip{a)pip{a')), (11) 

then the induced n-ary operation ip"^ on T (i.e., (f"^ is such that for every a G T^ one has 
(p'^{af) = p>{a)P) is continuous in the topology TJ-. 

4- Let {Ah,j) be a hyperfinite approximation of a uniformly locally compact algebra A, let {Ah)b 
and ~ be as defined in Proposition^!^ let r = {Ah, {Ah)b,^), and Ah = {Ah)b/ ~- Then the 
isomorphism of algebras Ah and A induced by the homomorphism l: {Ah)b A of Proposi- 
tion \^is an isomorphism of topological algebras with respect to the topology Tr on Ah- 

A proof of this theorem for the case of locally compact abelian groups is contained in |2j and 
in It can be transferred without any changes to the general case. 

Let Ah = {Ah,0) be an internal algebra, let {Ah)b = {{■^h)b-,Q) and let p be a vr-equivalence 
relation on Ah. We say that the triple r = {Ah, {Ah)b-, p) is a nonstandard topological ^-triple, 
if p \ {Ah)b is a congruence relation on {Ah)b (i-e., (11) holds for all operations ip from 9) and 
{Ah, {Ah)b,p) is an abstract nonstandard topological triple. 

Theorem |2l2) shows that if r = {Ah, {Ah)bj p) is a nonstandard topological ^-triple, then the 
quotient algebra Ah = {Ah)b/p is a topological algebra with respect to the topology %-. 

We say that a topological algebra A = {A, 6) is abstractly approximable by finite algebras from 
a class fC, if there exists a hyperfinite topological 6'-triple r = {Ah, {Ah)b,p) such that Ah G */C 
and A is topologically isomorphic to Ah- 

Theorem |31 together with Proposition [3 show that if A is approximable by finite /C-algebras, 
then it is abstractly approximable by finite /C-algebras. 

The following question is open. Is is true that any locally compact algebra A that is abstractly 
approximable by finite /C-algebras is approximable by finite /C-algebras in the sense of Definition 
IIP 
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It is easy to see that Theorems 1 and 4 of (Tj stay true if we replace approximabihty (of 
groups by finite quasigroups and finite semigroups) by abstract approximabihty (of groups by finite 
quasigroups and finite semigroups). 

This imphes the following proposition, which strengthens Theorem ^ 

Proposition 8. No infinite locally compact field is abstractly approximable by finite (associative) 
rings. 

An interesting discussion about the relations between real analysis and discrete analysis is 
contained in [2Z1- The main idea of that paper is expressed as follows: "Continuous analysis and 
geometry are just degenerate approximations to the discrete world .... While discrete analysis 
is conceptually simpler . . . than continuous analysis, technically it is usually much more difficult. 
Granted, real geometry and analysis were necessary simplifications to enable humans to make 
progress in science and mathematics . . . " . 

The discussion in this section shows how the idea that continuous mathematics is an approxi- 
mation of the discrete could be formalized. We may assume that we deal only with finite sets, but 
some of these sets are so big that they contain some only vaguely defined subclasses, which do not 
satisfy all the properties of sets. For example, the induction principle fails for these subclasses. For 
example, recall the well-known paradox of the pile of sand, due to Eubulides, IV century B.C.: one 
grain of sand is not a pile, and if n grains of sand do not form a pile, then n + 1 grains also do not 
form a pile; so, how can we get a pile of sand? According to our approach, hyperfinite sets of infinite 
cardinality simulate such large sets and external subsets simulate their vaguely defined subclasses. 
This follows from the obviously true statement: "A hyperfinite set has a standard cardinality iff all 
its subsets are internal" . Under this approach the set of all grains of sand is hyperfinite and a pile 
of sand is an external subset of this set^. 

According to Proposition [7] and Corollary ^ for every locally compact algebra A there exists 
a hyperfinite algebra Ah, an external subalgebra {Ah)b and an equivalence relation ~ such that A 
is isomorphic to {Ah)b/ ~- So {Afi)b can be viewed as a subclass of feasible elements and ~ as an 
indiscernibility relation. 

Proposition IS] together with the results on non-approximability of Lie groups from [T] explain, 
in some sense, why continuous analysis is simpler than discrete analysis. The discrete algebraic 
structures that are used in science need not have algebraic properties as good as those possessed 
by the corresponding continuous structures. 

We complete this section with a formulation of the concept of approximabihty in terms of 
ultraproducts. 

If an algebra A is discrete (see Remark^, then Definition |2l^4) of the concept of approximation 
of A by finite /C-algebras can be reformulated in the following way. 

Proposition 9. A discrete algebra A of a finite signature 6 is approximable by finite KL-algebras iff 
for any finite subset C C A there exists a finite algebra Ac S end a map j : Ac — > A such that 

1. CcjjAc). 

^P.Vopenka }26] suggested an axiomatic set theory for the formalization of this idea. The main defect of his 
approach is its opposition to classical mathematics. Another axiomatization of hyperfinite sets was suggested in j^, 
where classical mathematics was interpreted in the framework of hyperfinite sets. 
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2. For any n-ary function symbol f £ and for any a £ such that j{a) G C and f{j{a)) G C , 
one has 

j{fc{a)) = f{j{a)), 
where fc is the interpretation of f in Ac ■ 

In [ini are presented some examples of locally compact groups G such that G is approximable 
by finite groups as a discrete group but G is not approximable by finite groups as a topological 
group. 

The following proposition is contained in 20 . (A proof can also be found in ^.) 

Proposition 10. A discrete algebra A is approximable by finite IC-algebras iff A is isomorphic to 
a subalgebra of an ultraproduct of finite IC-algebras. 

Theorem 121 together with Proposition Q can be considered as a generalization of Proposition 1101 
to the setting of approximation of topological algebras. 

Indeed, if our nonstandard universe is a A'''-saturated ultrapower of a standard universe, then 
any hyperfinite algebra Ah G *IC is isomorphic to an ultraproduct of finite /C-algebras. Internal 
subsets of Afi correspond to subsets of this ultraproduct that are ultraproducts themselves. Unions 
(respectively, intersections) of at most A many internal subsets are called u-sets (respectively, vr- 
sets). Combining Theorem |21 and Proposition [7| with these remarks we obtain the following: 

Proposition 11. If a uniformly locally compact algebra A of signature 6 is approximable by finite 
algebras from a class fC, then A is isomorphic to a quotient algebra of a a-subalgebra of some 
-saturated ultraproduct B of finite IC-algebras with respect to some tt- equivalence relation p on B, 
such that p \ B(j is a congruence relation. (Here A is the weight of the topology on A). 

The necessity in Proposition^] is a special case of Proposition II II Indeed, it is easy to see that 
if the topology on A is discrete, then the equivalence relation p is the relation of equality. (See 
Proposition [7|) 

4 Positive bounded formulas and finite approximations 

In this section we consider first order statements true of a locally compact algebra A, and we inves- 
tigate approximate versions of those statements that hold in finite approximations of A. We start 
with approximations of statements that are formulated in the language of nonstandard analysis. 

Let Lq be the set of all first order formulas in the signature 9 and let V'(xi, . . . , Xn) G Lq. Denote 
by (fr^ the formula obtained from (p by the replacement of each atomic subformula ti = t2 by the 
formula ti ~ here ti and t2 are terms in the signature 6, 

Let {Ah,j) be a hyperfinite approximation of A. Then the formula ip^ has an obvious interpre- 
tation in the algebra {Ah)b of feasible elements of Ah (cf. Proposition Ej). Every term t{xi, . . . , x„) 
of signature 6 is interpreted by a function tj, on (Ah)^, obtained by substitution of the function fi, 
for any function symbol / involved in t (we denote the restriction of fh to {Ah)b by /b). Then for any 
ai, . . . ,a„ G {Ah)b one has {Ah)b |= hiai, ... ,an) ^ ^2(01, ...,««) iff the elements (ti)fe(ai, . . . ,a„) 
and (^2)6(01, • • • , fln) are indiscernible. The following proposition is an immediate corollary of 
Proposition [7J 
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Proposition 12. If{Ah,j) is a hyperfinite approximation of A then for any formula (p{xi, . . . , x„) G 
Lq and any ai, . . . , a„ G {Ah)b one has 

{Ah)b 1= y^^{ai, . . . ,a„) A 1= ip{°j{ai), °i(a„)). 

Remark 5. The same proposition is true also for any abstract hyperfinite approximation of A if 
we replace A by Ah and °j(aj) by the canonical image of a, in Ah- 

^From the point of view of computer numerical systems discussed in the Introduction, Proposi- 
tion 2 has the following interpretation. In the setting of nonstandard analysis, we can consider an 
idealized computer that has a hyperfinite memory. Then the numerical system M/^ for simulating 
the field of reals that is implemented in this computer is a hyperfinite algebra in the signature 
a = (+, x) and M/^ is a hyperfinite approximation of R. So Proposition provides a lot of 
information about M/j. 

Suppose = max{|Q| | a G K/i}- Then the elements of {M.h)b can be considered as elements 
that are far enough from the end points of the interval [—N, N] so that exponent overflow never 
occurs in computations involving them. It is very natural that the property of being "far enough 
from the end points of the interval [—N, N]" is an external property: if a natural number n is 'far 
enough from the end points" then obviously the same is true for n + 1. Thus the induction principle 
fails for this property. Proposition El shows that the first order properties of M hold approximately 
for the computer implementation of M, as long as we only consider elements that are far enough 
from the end points of the interval [—N,N]. This fact seems to be very clear for those who use 
computers for numerical computation. The language of nonstandard analysis makes it possible to 
formulate a rigorous mathematical theorem that expresses this phenomenon. 

Example 4 Consider the algebra Apq discussed in Example 1 of section 2. It is easy to see that if 
P,Q & *N\N, then Ap^q is a hyperfinite approximation of M (here j is the inclusion map). Consider 
a formula ip{x,y) of the signature a = (+, x). Let M |= '\/x3yip{x,y). Put ip{x) = 3\yip{x,y), 
r/(x) = 3yi, 2/2(2/1 7^ y2 A if{x,yi) A ip{x,y2)), where 3lyip{x,y) means that there exists a unique y 
such that ip{x,y). Assume that for every rational number a one has 

M 1= V(a) (12) 

Thus, *M 1= Tp{a) holds for every a G Apq. Let us assume also that there exists an irrational a 
such that 

R 1= r]{a) (13) 

Consider the following question. Given an arbitrary a G M, how can we determine whether 
a satisfies (12) or (13) using only our computer? The qualitative answer to this question is the 
following. If a satisfies (12), then for all precise enough approximations ai and 02 of a, any bi and 
62 such that ip{ai, bi) and (/?(a2, 62) are true with a high accuracy must be very close to each other. 
If a satisfies (13), then there exist two arbitrarily precise approximations ai and 02 of a and two 
significantly distinct 61 and 62 such 99(01,61) and f{a2,b2) are approximately true. 

A rigorous mathematical statement that reflects this qualitative answer follows from Proposition 
[T2I Indeed, it is easy to see that 

iApQ)b 1= yxi,X2iip^{xi) A ^^(2:2) A xi ~ 2:2 ^ Vyi,y2(v^~(a:i,yi) A ip^{x2,y2) ^ yi ~ ^2)) (14) 
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and 



{-^PQ)b 1= Vx(t/^(x) 3xi,X2,yi,y2{^^{xi,yi)/\(p^{x2,y2)^xi ~ xAx2 ~ xA-.(yi,~ ^2))) (15) 

Let us illustrate this discussion by a very simple numerical example. Consider the following 
system 

I = o (16) 

\ ax + by = 2 ^ ^ 

This system has 

1. a unique solution, if 7^ b, 

2. no solutions if = 6 7^ v^, 

3. infinitely many solutions if a'^ = 6 = v^. 

In the last case the general solution is given by the formula 

x+^^■y = ^^ (17) 

Performing numerical calculations on a computer, we deal only with rational numbers. Thus, 
the third case cannot occur in computer calculations. 

Taking the 5-digit approximations to and for a and b and solving the system (16) on a 
computer we obtain the solution x' = 0.74552, y' = 0.6682, which satisfies (17) with accuracy 10~^ 

Taking the 10-digit approximations to and for o and b and solving the system (16) 
we obtain the solution x' = —0.9979450387, y' = 2.051990552, which satisfies (17) with accuracy 
10^^'^. We see that these two approximate solutions of the system (16) are significantly distinct 
(compare with (15)). 

In the language of nonstandard analysis it is only possible to formulate mathematical theorems 
that give us some qualitative picture of the connection between continuous problems and their 
computer simulations. To obtain specific estimates it is necessary (but not sufficient) to formulate 
a standard version of Proposition I12L 

In the language of classical mathematics, we can only consider approximate properties of reals 
that hold eventually when the memory of computers increases to infinity and the accuracy becomes 
more and more precise. We will see that only a restricted result can be obtained in this way. 

We say that a formula (f £ Lg is positive if it can be built up from atomic formulas using 
only conjunctions, disjunctions and quantifiers. The main result of this section concerns positive 
formulas in prenex form 

) Xn ; yi ; • • • ) ym 

where the Qi are quantifiers and ip is a disjunction of conjunctions of atomic formulas. 

An arbitrary (not necessary positive) formula ip is equivalent to a formula in the form (18), where 
is a disjunction of conjunctions of atomic subformulas of ip and negations of atomic subformulas 
of V'- Let 7i, . . . , 7fc be the list of all atomic formulas and their negations involved in ip. For any 
1 < i < k axWi G W and denote by 7i[Wj] the formula (ti, t2) £ Wi if 7^ is ti = t2 and the formula 
{ti,t2) ^ Wi if 7j is -i(ti = t2)- Here ti and t2 are terms in the signature 9. 

Define the interpretations of the formula (ti,t2) £ W in A and in an arbitrary {C',W')- 
approximation {Af,jf) oi A, where {C',W') G M, as follows: 
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Let Ti,T2 & A he interpretations of the terms ti and t2 in A. Then A \= (^1,^2) G Vl^ iff 
{ti,T2) e W. 

If ^1 and ^2 arc interpretations of the terms ti and t2 in Af, then Af \= {ti,t2) G iff 

0/(a),i/fe)) G^^. 

Denote by (^[Wi, . . . , Wk] the formula that is obtained from if by replacement of each 7j by 7i[VFi] 
respectively. The formula (^[VFi, . . . , W/-] is called an approximation of (p. Obviously, if (p is positive, 
then for any Wi, . . . , Wk G W one has ip =^ V^i^^i, . . . , Wk] (for both interpretations). This is not 
true in general if p is non-positive. Similarly, if W^ C Wi, i = 1, . . . k, then flWl, . . . , WjJ =^ 
(p[Wi, . . . , Wk] for a positive p but not generally if p is non-positive. For positive formulas we 
say in this case that (p[W[,..., Wj.] is a finer approximation than ip[Wi,..., Wk]- Obviously, 
for any approximation (/'[W^i; • • • > ^k] of a positive formula (p there exists a finer approximation 
p[W{, . . . , VFfc] such that W{ = ■ ■ ■ = Wl^ = W (it is enough to put = VFi n • • • n Wk). In this 
case we write p[W] instead of p[W, . . . , W]. In what follows we deal only with approximations of 
the form <p[W] of a positive formula ip. 

If i? C ^ and Q is cither V or 3 then Qb^ ... is interpreted in A by Va;(x G B ^ . . . ) or 
3x{x G B A . . .) and in a finite (C, VF)-approximation {Af,jf) of .4. by Vx(x G jJ^{B) —>■ . . . ) or 
3a;(x ejJ^{B)A ...). 

Quantifiers of the form are called bounded quantifiers. If all quantifiers in a formula (p are 
bounded then we say that tp is bounded. 

Let c = {Ci, . . . , Cm) be an m-tuple of subsets of A and let (p he a positive prenex formula as 
in (18). Then (p[c] is the formula 

Qiciyi---QmCmymi'- (19) 

A formula of the form (19) is said to be a positive bounded formula. 

In what follows we consider only positive bounded formulas p[c] that satisfy the following 
condition: 

for any i < m such that Qi = 'i (respectively, Qi = 3) the set Q is a relatively compact open 
(respectively, compact) set. 

In this case we say that an m-tuple c of subsets of A is (/^-regular. 

Example 5 Consider the signature a' obtained from the signature a = (®, (g)) by adding a constant 
for each real number. Let <^ be a formula of the form (18) in the signature a' and c be a 93-regular 
m-tuple that consists only of open and closed intervals. Since the relation x <y\s expressed by the 
positive formula 3z(y = x + z^) and the universal quantifiers are restricted to open intervals, while 
the existential quantifiers are restricted to closed intervals, it is easy to see that <^[c] is equivalent 
to a positive formula of the signature a' . 

For two (^-regular m-tuples c and c' we say that c <C c' if for any i < m the following property 
holds: 

if = V then Cj C d and ii Qi = 3 then Ci C int(Cj'). Here B is the closure of B and int(i?) 
is the interior of B. 

If c ^ c' and W eW then the formula (/^[c'JfVF] is called a strong approximation of ip[c]. The 
following lemma is obvious. 

Lemma 3. Let <p{xi, . . . , x„) be a positive formula of Lq of the form (18), ci <C C2, be (p-regular 
m-tuples of subsets of A, letW2 C Wi be elements of the uniformity W and {Af,jf) be a {C,W)- 
approximation of A for some (C, W) G M . Then 
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1. Vai, . . . , an ^ A{A\= Lp[ci]{ai, . . . , o„) ^ ^ (^[c2](ai, . . . , o„)); 

2. Mai, . . . , a„ G ^/(^/ |= 95[ci][W2](ai, • • • , =^ ^/ |= v?[ci][VFi](ai, . . . , a„)); 

5. Vai,. . . , On e ^/(^/ 1= (^[ci][W2](ai, • • • , ^ ^/ |= V5[c2][VF2](ai, . . . , a„)). 

This notion of approximation for positive bounded formulas is similar to the one introduced in 
[Tl| [TH] Uni) for structures based on Banach spaces. 

The following theorem is the main result of this section. 

Theorem 4. Let (p[c\{xi, . . . , Xn) he a positive hounded formula and ai, . . . , £ ^4. Then A |= 
(/?[c](ai, . . . , an) iff for any strong approximation (p[c']\W'] of ip[c\ there exists a pair (Co, Wq) G M 
such that the following conditions hold: 

n 

1) U ^o(ai) ^ Co; 
1=1 

2) for any {C^W) < (Co, Wo), for any {C,W)- approximation {Af,jf) of A and for any 
bi, . . . , bn £ Af such that {ai,j{bi)) £ Wq, i = 1, . . . ,n, one has Aj \= ip[c'][W']{bi, . . . , 

If for some property P there exists a (Co, Wq) S M such that P holds for all (C, VF)-approximations 
of A such that (C, W) < (Co, Wq), then we say that P holds for all precise enough approximations 
of A 

Corollary 2. A positive bounded sentence ip[c] holds in A iff all of its strong approximations 
ip[c'][W] hold in all precise enough approximations of A. 

^From the point of view of numerical systems implemented in computers this corollary means 
that approximate versions of positive bounded theorems about the reals hold for numerical computer 
systems that simulate the field of reals in powerful enough computers. 

Before we start to prove Theorem^ consider the following three examples. In these examples 
we deal with the algebra (M;l,+, x) and its (a, e)-approximations {Af,jf) (see Example 1) such 
that jf is the inclusion map. According to Definition 121^3), in this case we say that Af is an 
(a, e)-approximation of M. 

Example 6 Fix any positive d > 1. Then the following positive bounded formula holds for the 
field M: 

yDx3^y{xy = 1), 

where D = {x €R\ d~^ < \x\ < d}. 

It is easy to see that for any strong approximation of this formula there exists a finer strong 
approximation of the following form: 

ycx3By{\xy-l\<5), (20) 

where C = {x G M | < |x| < c}, i? = {x G M | < |x| < 6}, 1 < c < d < 6 and 5 > 0. 

We have to show that there exist ao, eo such that for any a > ao, e < eo, formula (20) holds for 
any finite (a, e)-approximation Af of M. Fix any x such that < |2;| < c and let y = < 
\y\ < b. Take ^,1] £ Af such that |x — ^| < e and |y — f?| < £■ The a and e have to satisfy the 
following conditions: ^,?7,^ x G [—a, a], \C V ~ M < where is the multiplication in Af. 
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By the definition of (a, e)-approximation, it is easy to see that the following and Eq satisfy the 
required conditions: 



£0 



'26 + l\^ , 26+1 



+ 6 — , ao = max{b + eo, (26 + £0)^0 + !}• 



Example 7 Let ip{x,y) be the positive formula 3z{x + = y), which defines the relation < in M. 

Consider a bounded version of this formula ip[b]{x,y) = 3\z\<b{^ + z'^ = y), which defines the 
relation x < y < x + b'^. A strong approximation of this formula is of the form (/?[c][a;](x, y) = 
3|2|<c(|x + 2;^ — y\ < a) for some a > and < 6 < c. Let xq, yo G [—d, d] and M |= ip[b]{xo,yo). Put 
flo = (c + a)^ + d + a + 1 and eo = max{c — b, 5^200 J"' '^^^'^ is easy to see that Aj |= ip[c] [a](^, r/), 
where Af is a (a, e)-approximation of M, a > ao, e < Eq, (,,r] G Af and |a:o — '^1 < £0, luo — "^1 < ^o- 
If xo > yo and a < ^{xq — yo), we may take eq such that xq — £0 > Uo + Thus, the formula 
<^[c][a;](^, 77) fails in Aj for any (a, e)-approximation Af of M and for any ^, E such that 
1 3^0 — I < £0, |yo — ^1 < eo- A similar consideration holds for yo > xq + b'^ . 

Example 8 The relation < can also be defined by a positive formula. Indeed: 

X <y 3z{{y - x)z^ = 1) = ^{x, y) 

A bounded version of this formula y) = 3\z\<b{{y ~ x)z'^ = 1) defines the relation y > x + ^. 

A strong approximation of this formula is of the form Lp[c\ [a] (x, y) = 3|2|<c(| (y — x)z'^ — 1| < a) for 
some a > and < 6 < c. It is easy to see that for a < 1, for small enough e, big enough a and 
for any (a, e)-approximation Af of M if ^, 77 G [—a, a] then Af |= (/?[c][a](^, 77) <^=^ > ^ + "^72^- 

Remark 6. It is easy to see that the relation u ~< v between normalized floating-point numbers 
u,v, introduced in ^3 page 200], is a special case of the approximation (^[c][q;] in Example 8. 

Remark 7. By a classical result of Tarski [21] any formula in the signature (+, x) is equivalent 
in the first order theory of the ordered field of real numbers (Th(M)) to a quantifier free formula 
in the signature (1,+, x,<)- Therefore, the examples considered above show that any formula of 
the language of rings is equivalent in Th(M) to a positive formula and thus has its approximate 
versions. 

Let the topological space A be totally disconnected; i.e., the clopen sets form a base of its 
topology. Consider a positive bounded formula ip[c] with an m,-tuple c that consists of clopen sets. 
In this case we say that c is clopen. Since for a clopen set V one has V '^V and V C int(y), then 
for a clopen 7TT,-tuple c one has c <C c. Thus ii W £ W, then '/7[c][Vl^] is a strong approximation of 
<f[c\. So the formulation of Theorem |1] can be simplified for this case. 

Corollary 3. Let A be a totally disconnected algebra, ip[c]{xi, . . . , Xn) be a positive bounded formula 
(19) with a clopen m-tuple c, and oi, . . . , a„ G ^4. Then A |= ip[c\{ai, . . . , 0^) iff for any W' G W 
there exists a pair (Co, VFo) S M such that the following conditions hold: 

n 

1) U Wo{ai) C Co; 

i=l 

2) for any {C,W) < {Co,Wq), for any {C,W)- approximation {Af,jf) of A, and for any 
bi, . . . , bn £ Af such that {ai,j{bi)) £ Wq, i = 1, . . . ,n, one has A' |= 99[c][iy](6i, . . . , 
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Now we turn to the proof of Theorem|lI First we consider an equivalent nonstandard statement. 

Let {Ah,j) be a hyperfinite approximation of A in the sense of Definition |3J Then a strong 
approximation (/?[c][VF] of a positive formula (p in the form (18) has an obvious interpretation in 
Ah- a quantifier Qcx . . . is interpreted as on page I19l and a formula (ti,t2) € is interpreted 
by {j ih) , j (h)) S *W. Obviously, the statements (2) and (3) of Lemma IHl hold for hyperfinite 
approximations of A. 

Lemma 4. For any Pi, ... , (3n G {^hjb one has 

Ah h ^[cUiPi, pn)^yw eWxAhh ^[c][Wm,. . . , (3n)- 

Proof Obviously, A |= f[c]^{Pi,- . . , (3n) ^ yW e Wx Ah \= f[c][W]{l3i , . . . , /3„). So we have 
to prove only the converse implication. Consider first the case of a quantifier free formula, i.e., the 
case when ip = ip in the form (18). We have ip = Pi V ■ ■ ■ V Pr, where each Pi is a conjunction of 
atomic formulas. Assume that WW € W\ one has If is false then for each i < r there 

r 

exists Wi G Wa such that Pi[Wi] is false. Take W e Wx such that W <^ f] Wi. Then by Lemma 

i=l 

I2t2) for any i < r the formula is false. Thus, the formula ^p[W] is false. 

We have to prove now that 

VVF G WxQic^yi . . . QmCmymm =^ Qicvi • • • Qmc^Vmyw E Wx^m 

To prove this implication, it is enough to prove that for any positive bounded formula r(x) and 
any compact set C one has 

VVF E Wx^cxt[W]{x) =^ 3cxyW E Wxt[W]{x). (21) 

Assume that the left hand side of this implication holds. Put B{W) = {x \ j{x) E *C, r[Ty](x)}. 
Then B{W) / 0. Since for any . . . , E Wa there exists W £ Wx such that WO f] Wi, 

i=l 

using Lemma|3t^2), we obtain that the family {B(W) \ W E Wa} has the finite intersection property. 
Thus, by saturation, we obtain that the right hand side of the implication (21) holds. □ 

Lemma 5. Let (p{xi, . . . , Xn) be a positive formula in Lq of the form (18), c = {Ci, . . . , Cm) o, 
If -regular m-tuple of subsets of A, ai, . . . , an £ A, and {Ah,j) a hyperfinite approximation of A. 
Then A |= (/9[c](ai, . . . , a„) iff for any ip-regular d = {C[, . . . , C^) such that c' ^ c and for any 
ai, . . . , On & Ah such that j{ai) ~ Oj, i = 1, . . . ,n one has Ah |= v?[c']^(ai, . . . , a„). 

Proof We prove this lemma by induction on m. For m = it follows from Proposition 1121 Assume 
that it is proved for m—1. Denote by T(yi, xi, . . . , Xn) the formula Q2y2 ■ ■ ■ QmUmi'^xi, . . . , Xn, yi, . . ■ , 
by c_ the (m — l)-tuple (C2, . . . , Cm), by c'_ the (m — l)-tuple (C2,..., C'm), so, that (/? = 
QiViT, (p[c] = QiciVitIc-], (p[c'] = Qic[yiT[c'-]- Consider two cases, 
a). Qi = 3. In this case Ci,C[ are compact sets and Ci C intC(. 

^ Let A 1= (/9[c](ai, . . . , o„). Then there exists 6 E Ci such that A |= r[c_](5, oi, . . . , o„). Let 
P G Ah he such that j{P) b. Then, by the induction assumption. Ah |= r[c'_]^(/3, ai, . . . , a„). 
Since 6 E Ci C =1nt(C0 C *C[, j{P) « b and mt{C[) is an open set, we have E 1nt(C(). This 
proves that Ah |= f[c']^{ai, . . . , a„). 

^. Obviously Ci = Cli^iCi) \ W E Wa}. Fix any V,W £ Wx ■ By the assumption of the 
lemma, for any r-regular (m — l)-tuple c'„ » c_ one has Ah \= 3TjnT^yiT[c'_]n^{ai, . . . , a^). Thus, 
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by LemmaH we have B{W,V,c'_) = {/? G r^{*W{Ci)) \ Ah N t[c'_][V]{P , ai , . . . , an)} + 0. 
Let H be the set of all r-regular (m — l)-tuples d_. Then it is easy to see that there exists a 
cofinal subset r.x (i.e., Vd G HBdi G <^ d)) of cardinality A. By Lemma EfS), if for some 

b,ai,... , On G {Ah)b for all d £ Ex one has Ah |= ''"['^][^], then the same holds for all d G S. 
It is easy to see also that, similar to Wa, the family has the following property: for any 
c^^\ . . . ,c(*) G E\ there exists a c'_ G such that c'_ ^ c^-'^^ . . . ,c'_ ^ c^'^^. All this shows that 
the family {B{W,V,c'_) \ V,W £ Wx,c'_ G H^} has the finite intersection property and thus, 
by saturation, has nonempty intersection. By our construction and Lemma 0J any element (3 in 
this intersection has the following properties: j{[3) G *Ci and Ah |= r[c'_]^(/3, ai, . . . , a„) for any 
c'_ G H. By the induction assumption this implies that A |= r[c_]( ai, . . . , a„). Since C is a 
compact set, we obtain that G C. This proves a). 

b)Qi = V. In this case Ci and C[ are relatively compact open sets and C[ C Ci 
^ Let ^ 1= V3[c](ai, . . . , an) and ai, . . . , G {Ah)b be such that ~ Oj. Take any (3 £ Ah 

such that G *C(. Then b = °j{P) G Ci and, thus, ^ |= r[c_](6, ai, . . . , o„). By the induction 
assumption. Ah |= t[c'_]^(/3, ai, . . . , a„). This completes the proof. 

Let 6 G Ci. Obviously, there exists an open Z) such that D <Z Ci and b £ D. Since for any 
c'_ » c_ and for any ai, . . . , a„ G (A^);, such that j(ai) ~ one has |= VD2/iT[c'_]^(yi, ai, . . . , a^), 
we obtain that for any (3 £ Ah such that j{f3) « 6 one has Ah |= T[c']n^(/?, ai, . . . , a^). Thus, by 
the induction assumption A |= t[c](6, oi, . . . , a„). □ 

Proof of Theorem|4](=^) Let ^ 1= (^[c](ai, ... , an). Fix a strong approximation 99 [c'] ... , Xn) 

of 99[c](xi, . . . , x„) . Consider the internal set A'' of all pairs {Cq,Wq) £ *M\ such that for all 
{C,W) < (Co, Wo), for any ( *C, W)-approximation {Ah,j) of *A and for any ai,..., a„ G Ah 
satisfying the condition (ai,j(aj)) G Wq one has Ah |= V9[c][VF](ai, . . . , a„). Lemmas ^ and 
121 imply that N contains all infinitesimal pairs (Co,VFo) G *Mx- By Lemma ^2), there exists 
(Co, Wo) G Mx such that ( *Co, *Wo) G N. By the transfer principle, this completes the proof. 

Let c' ^ c, {Ah,j) be a hyperfinite approximation of A and ai, . . . , On £ Ah he such that 
j(oi) ~ a?.- Then for any (C, W) G Ma the pair {Ah,j) is a (*C, *W)-approximation of VI and 
{j{ai),ai) £ *W, i = 1, . . . ,n. Thus, by the conditions of the theorem. Ah |= c/?[c'][W'](ai, . . . , Un) 
for any W' G Wa. By Lemma |3J Ah \= ip[c]^{ai, . . . , a„). Hence, by Lemma El one has A |= 
ip[c]{ai, . . . , an). □ 
The following corollary of Theorem shows that the approximation of continuous functions by 
polynomials on closed intervals holds for all precise enough approximations of the field M (cf. the 
example concerning sinx which was discussed in the Introduction). 

Corollary 4. Let A = (M, a) be such that a contains the symbols + and x and a unary function 
symbol g. Suppose that the continuous function g is approximable on an interval [—d,d] by a 
polynomial bnX^ + • • • + b\x + 60 with accuracy 6. Then for any < d' < d and S' > 6 there exist 
ao,eo > such that any {a, e)- approximation {Af,jf) of A with a > ao and e < Eq has the following 
property: for any (3o, . . . , (3n,C ^ Af, if \j{f3i) - bi\ < eq for all i = 0, . . . ,n and j{S,) £ [-d', d'], 
then \jf{gf{S,)) — jf{[3ni^ + • • • + + /3o)| < 5' ■ (Here gj is the interpretation of the symbol g in 
Af.) 
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